Improving QA Accuracy by Question Inversion
نویسندگان
چکیده
This paper demonstrates a conceptually simple but effective method of increasing the accuracy of QA systems on factoid-style questions. We define the notion of an inverted question, and show that by requiring that the answers to the original and inverted questions be mutually consistent, incorrect answers get demoted in confidence and correct ones promoted. Additionally, we show that lack of validation can be used to assert no-answer (nil) conditions. We demonstrate increases of performance on TREC and other question-sets, and discuss the kinds of future activities that can be particularly beneficial to approaches such as ours.
منابع مشابه
Three-dimensional inversion of magnetotelluric data in complex geological structures
Int erp retation of magneto telluri c data over inhomogeneous geolog ical st ructures is st ill a challenging problem in geophysical exploration. We have developed a new 3-D MT inversion method and a computer code based on full nonlinear conjugate gradient inversion and quasi analyt ical approximation for forward modeling solut ion. Appli cat ion of the QA approximation to forward model ing a...
متن کاملImproving Text Retrieval Precision and Answer Accuracy in Question Answering Systems
Question Answering (QA) systems are often built modularly, with a text retrieval component feeding forward into an answer extraction component. Conventional wisdom suggests that, the higher the quality of the retrieval results used as input to the answer extraction module, the better the extracted answers, and hence system accuracy, will be. This turns out to be a poor assumption, because text ...
متن کاملOptimizing Question Answering Accuracy by Maximizing Log-Likelihood
In this paper we demonstrate that there is a strong correlation between the Question Answering (QA) accuracy and the log-likelihood of the answer typing component of our statistical QA model. We exploit this observation in a clustering algorithm which optimizes QA accuracy by maximizing the log-likelihood of a set of question-and-answer pairs. Experimental results show that we achieve better QA...
متن کاملLearning to Admit You’re Wrong: Statistical Tools for Evaluating Web QA
Web search engines provide specialized results to specific queries, often relying on the output of a QA system. However, targeted answers, while helpful, are embarrassing when wrong. Automated techniques are required to avoid wrong answers and improve system performance. We present the Expected Answer System, a statistical data-driven framework that analyzes the performance of a QA system with ...
متن کاملInvestigating Embedded Question Reuse in Question Answering
The investigation presented in this paper is a novel method in question answering (QA) that enables a QA system to gain performance through reuse of information in the answer to one question to answer another related question. Our analysis shows that a pair of question in a general open domain QA can have embedding relation through their mentions of noun phrase expressions. We present methods f...
متن کامل